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(57) Abstract: A method and an apparatus used, for example, in conjunc- 
tion with a computer or similar device, provides for multi -resolution render- 
ing of image data, where the image data includes background image data, 
vector data and text data, so as to accommodate memory capacities of ren- 
dering devices. The computer (22) may send image data in a multi -resolu- 
tion format from the computer to one of several rendering devices (20, 40, 
50, 60, 70). The multi-resolution format may be achieved by frequency do- 
main coding (420) or generation of image swaths (410), or a combination 
thereof. The image data may first be sent (505) in a low resolution format, 
and a rendering device determines, based on its memory, whether the corre- 
sponding image or text should be rendered. Next, vector data (510) and/or 
text data (515) may be supplied to the rendering device. Then, higher resolu- 
tion data may be sent (525, 535) after the text/vector date so as to maximize 
memory usage of the rendering device. Additionally, in a printing appli- 
cation, the image data may be divided into swaths (310), with each swath 
separately provided to a printer. 
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1 METHOD AND APPARATUS FOR LOW MEMORY RENDERING 

2 Technical Field 

3 The technical field is rendering images from an image data contained in a digital 

4 file. 

5 Background 

6 Rendering devices are used to generate an image based on input image data. The 

7 input image data may be digital data contained in a file that is stored in a memory, such as 

8 a memory associated with a personal computer. Rendering devices may take many 

9 forms, and may be portable or essentially fixed. Examples of rendering devices include a 

10 cellular telephone, a facsimile machine, a computer with a display, and a printer. The 

11 cellular telephone may receive data from a wireless telephone network and may render 

12 text and graphical images on a display screen. The facsimile machine may render images 

13 and text onto paper or other suitable media. The computer may receive and store the 

14 image data and may concurrently, or subsequently, render the image on the display. 

15 Printers may receive image data from an attached computer, and may store die image data 

16 prior to rendering. Rendering devices used in connection with personal computers, or 

17 other computers and similar devices, are capable of rendering images and text either as bit 

18 map data or line drawing images. Image data supplied to the rendering device may be 

19 photograph data from a digital camera, data generated by a computer graphics package, or 

20 simply text data generated, for example, by a word processing program. Printers used to 

21 render the image data may be large format printers capable of printing* posters, 

22 architectural images, and other large images. The printers may also include more 

23 common laser printers and ink jet printers, 

24 In the specific case of a printer, print data received by the printer from a computer 

25 may include bit map data specifying an image in the form of a bit map, vector data 

26 specifying features in terms of vectors, and text data specifying text characters. For 

27 example, an architect's printing requirements may include a background photograph 

28 showing a building site, and superimposed, a computer generated image of a building 

29 having rendered texture and tones. The architect's image may also contain arrows and 

30 text pointing to individual features on the building, with the arrows and text superimposed 

3 1 either over the computer generated image or the background photograph. 

32 However, many rendering devices do not have enough memory capacity to store 

33 an entire image to be rendered. As a result, the image to be rendered may be rendered 

34 with data missing, such a broad white stripe running the length of the image, for example. 
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1 Summary 

2 A rendering system used, for example, in conjunction with a computer or similar 

3 device, provides for multi-resolution rendering of image data, comprising background 

4 image data, vector data and text data, so as to accommodate memory capacities of 

5 rendering devices in the rendering system. The computer may send the image data in a 

6 multi-resolution format from the computer to one of several rendering devices coupled to 

7 the rendering system. Background image data may first be sent in a low resolution 

8 format, and the rendering device determines, based on a memory capacity of the 

9 rendering device, whether the corresponding image or text should be rendered. Next, 

10 vector data and/or text data may be supplied to the rendering device. In this way, the 

11 rendering device initially receives low resolution background image data together with 

12 vector data and text data for any vectors or text that overlay the image data. Finally, the 

13 computer sends refined image data in a high resolution format. In an embodiment, 

14 sending the high resolution image data may occur over several iterations, with each 

1 5 successive iteration providing higher resolution data. 

16 In an embodiment, the rendering device is a printer that receives low resolution 

17 background image data followed by the vector data and/or the text data, and stores the 

18 received data in memory. Because the background image data is in a low resolution 

19 format, the printer does not need a large amount of memory to store the background 

20 image data along with the vector and/or text data. The printer then receives refined 

21 background image data in a high resolution format. Depending on the amount of 

22 available memory, the printer may store the refined, high resolution image data. In an 

23 embodiment, the printer accumulates higher resolution image data until the capacity of 

24 the printer's memory is reached, at which point the printer combines the lower resolution 

25 image data with the higher resolution image data in order to render the image. Depending 

26 on the printer memory, the highest resolution image file is stored, and printing of the 

27 image data includes the highest resolution image data. For printers having a lower 

28 memory capacity than that required to store the highest resolution image data, printing 

29 may proceed based on intermediate resolution image data, and any vector and/or text 

30 data. 

31 In an alternative embodiment, and as applied to specific printer types, a printer 

32 driver in the computer may send the printer only as much print data as can be stored in the 

33 printer memory. In another embodiment, the computer may break the print data into a 

34 series of swaths or bands, with each swath representing a portion of the print data. A first 
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1 swath of the print data may include image data, vector data, and text data that would be 

2 printed in a specified height on a printing medium. For example, when printing on a 

3 standard 81/2X11 page, the first swath may represent the first two inches of the page. 

4 The print" data for the first swath may be stored in the printer memory, and that portion of 

5 the print data may be used to print an image portion on the page. The print data are then 

6 discarded from memory, and the computer sends print data for the next swath to the 

7 printer. This process continues until the entire page is printed. 

8 In yet another embodiment, the printer system uses a combination of printing by 

9 swaths, and multi-resolution printing within one or more of the swaths, to provide the 

10 highest possible image resolution and to maximize use of the printer memory. 

1 1 Description of the Drawings 

12 The detailed description will refer to the following drawings in which like 

1 3 numerals refer to like elements, and in which: 

14 Figures la - lb illustrate a system that uses multi-resolution rendering; 

15 Figures 2a - 2c illustrate a conceptual model and process for multi-resolution 

1 6 coding to be used for low-memory rendering; 

17 Figures 3a - 3c illustrate a relationship between image quality and bitmap transfer; 

1 8 Figure 4 illustrates an alternative approach to low-memory rendering; 

19 Figure 5 illustrates schematically an image data file; and 

20 Figures 6 - 9 are flowcharts illustrating processes for low-memory rendering. 

2 1 Detailed Description 

22 Figure la illustrates a system 10 adapted for multi-resolution rendering as a 

23 solution for low-memory rendering devices. The system 10 includes an image data 

24 source 20, which may be a personal computer 22 or a wireless device 24, and a plurality 

25 of rendering devices, including a computer display 30, a laser printer 40, an ink jet printer 

26 50, and a large format printer 60. The wireless device 24 and the personal computer 22 

27 may communicate with any and all of the plurality of rendering devices, and may send 

28 image data to any and all of the plurality of rendering devices in order to render images 

29 and text. The wireless device 24 may be a wireless computer, a personal data assistant, or 

30 a cellular telephone, for example. Furthermore, a display on the wireless device 24 may 

31 also be a rendering device within the system 10. The personal computer 22 may be 

32 coupled to any and all of the plurality of rendering devices by an appropriate cable 

33 connection. The system 10 may be part of a larger networked computer system in which 
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1 several personal computers are connected to a central server (not shown) and in which the 

2 personal computers share resources, including the plurality of rendering devices. 

3 Individual rendering devices may have different memory capacities. For example 

4 the ink jet printer 50 may have a data storage capacity of 64 MegaBytes in RAM, the 

5 laser printer 40 may have a storage capacity of 128 MegaBytes in RAM, and the large 

6 format printer 60 may have a data storage capacity of 20 GigaBytes in a hard drive. The 

7 description that follows will refer to a printing system as an exemplary embodiment of 

8 low-memory rendering. However, those of ordinary skill in the art will recognize that 

9 similar techniques may be used with rendering devices other than printers. 

10 Figure lb illustrates a printer 70 and corresponding image data source 20, for 

1 1 example the personal computer 22. The printer 70 includes a communications port 72, a 

12 print mechanism 73, a processor 74, a memory 75, and a print application 76. The image 

13 data source 20 includes a communications port 101, a data storage device 102, which may 

14 be a hard drive, a processor 103, a memory area 104, a user interface 105, which may 

15 include a video monitor, keyboard, and pointing device, an operating system 106, a 

16 printer driver 107, and an applications program 108. The printer 70 and the image data 

17 source 20 may communicate using a local area network cable 1 10. 

18 The printer 70 operates the print application 76 written in a known printing 

19 language such as Hewlett-Packard Graphics Language 2 (HPGL2), which is capable of 

20 handling bit maps and vectors, or HP Raster Transfer Language (HPRTL), which is 

21 capable of receiving bit map data in rasterized form. The print application 76 converts 

22 the print data into a form in which the print mechanism 73 can produce a printed image. 

23 Image data, and in particular image data sent by the image data source 20, may be 

24 sent to the printer 70 without the print data source having any knowledge of the memory 

25 capacity of the printer 70. The image data so transferred may be layered, and each layer 

26 of the image data may be sent from the image data source 20 to the printer 70 as 

27 successive digital data files of increasing higher resolution. That is, the image data source 

28 20 may sample the image data at different resolutions, with each such sample comprising 

29 a resolution layer, and the successive resolution layers are then sent to the printer 70. The 

30 image data sent to a printer 70 will be the same, regardless of the memory capacity of the 

31 printer. For example, and referring to Figure la, the personal computer 22, as the image 

32 data source 20, will send the same data, in the same resolution layers to each of the 

33 printers 40, 50, and 60, even though the memory capacity of the printers 40, 50, and 60 is 
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1 different. As a result, the format of the image data sent from the image source 20 can 

2 remain fixed, regardless of the image data destination. 

3 The system 10 shown in Figure la may be used to render images of acceptable 

4 quality by rendering a subset of image data corresponding to a background image of the 

5 image to be rendered, rendering text and/or vector data of the image to be rendered, and, 

6 depending on memory capacity of the rendering device, rendering additional image data 

7 corresponding to the background image. To accomplish this low-memory rendering, the 

8 data corresponding to the image to be rendered may be divided according to a first rule to 

9 produce multiple first data segments. Each of the first data segments may then be divided 

10 according to a second rule to provide multiple second data segments. The first rule may 

11 generate multiple swaths as the first data segments and the second rule may produce 

12 multi-resolution levels for each of the swaths. In the rendering device, each swath is then 

13 rendered using a multi-resolution rendering method. In an embodiment, only the multi- 

14 resolution data segmentation is performed. The multi-resolution and swath methods will 

15 be described below. 

16 Figures 2a - 2c illustrate a conceptual model of multi-resolution coding using 

17 frequency domain compression. Such a multi-resolution coding scheme may be used to 

18 improve the speed and efficiency of printing when using a low memory printer. The 

19 conceptual model shown in Figures 2a - 2b relies on JPEG discrete cosine transformation 

20 (DCT) coding. However, other frequency-domain coding schemes may also be used to 

21 enhance printing efficiency, including wavelet coding and region-based subband coding. 

22 In Figure 2a, the coding scheme uses JPEG DCT coding for processing 8X8 

23 blocks of pixels from an image bitmap to form an encoded image that may be transmitted 

24 to a print device for decoding and printing. The encoding process begins with a DCT step 

25 that transforms a two-dimensional block of pixels from the spatial domain to a two- 

26 dimensional array of frequency coefficients in the frequency domain. The DCT step 

27 decorrelates the 64 image pixels in the 8X8 pixel block and concentrates most of the 

28 pixel's energy into coefficients in the top left corner of the frequency array, leaving the 

29 remaining pixels with near-zero values. Among the frequency coefficients, the DC 

30 coefficient represents the average intensity value of the 64 pixels in the spatial domain. 

31 The other coefficients represent spatial features occurring at different frequencies in the 

32 8X8 block of pixels. Within the frequency coefficient array, the lowest frequency 

33 coefficients are located in the upper left and the highest frequency coefficients in the 
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1 lower right. The DCT step is a lossless operation because, if the coefficients are 

2 represented with sufficient accuracy, the 8X8 block of pixels can be recovered exactly. 

3 The next step is quantization, a lossy operation that drives small, nonessential 

4 frequency components to zero by scaling each frequency coefficient to the nearest 

5 multiple value found in a quantization table. A zig-zag sequence is used to read out the 

6 quantized frequency coefficients into a one-dimensional array in preparation for 

7 transmission to the print device. This sequence orders the frequency coefficients from 

8 lowest to highest, allowing further encoding to be applied for efficient transmission to the 

9 print device. 



10 Upon receipt at the print device, such as the printer 70, a decoder in the print 

1 1 device, using the same quantization table as that used in the encoding device, dequantizes 

12 the quantized coefficients. An inverse DCT step is then performed to approximately 

13 recreate the 8X8 blocks of pixels. 

14 The JPEG DCT coding scheme may be implemented in a hierarchical manner, 

15 providing progressive coding with increased spatial resolution between successive stages. 

16 Thus, the image to be printed is encoded at multiple resolutions so that lower-resolution 

17 versions may be transmitted to the print device and printed without having to decompress 

1 8 the image at its full resolution. 

19 As noted above, other frequency coding schemes may be used to enhance low- 



20 , memory printing. Wavelet coding uses localized basis functions to break down an image 

21 into its essential details. Using short-duration waves, rather than a continuous sinusoid as 

22 in DCT coding, wavelet coding can more efficiently represent small features in an image, 

23 such as rapid transitions that occur at an edge of an object. In addition, wavelet coding 

24 allows for full image encoding, rather than the 8X8 block encoding structure used by 

25 DCT transform coding. These advantages allow wavelet coding to provide higher 

26 compression ratios for a given image quality. 



27 Yet another coding scheme is region-based subband coding (RBSSC), described 

28 in detail in "A region-based subband coding scheme," by Joseph Casas and Luis Torres, 

29 which is hereby incorporated by reference. 

30 Figure 2b illustrates the concept of JPEG DCT coding as a solution to low- 

31 memory rendering. An initial image to be rendered comprises a background image, 

32 vectors, and text. The background image may be divided into 8X8 blocks of pixels. Each 

33 of the 8X8 pixel blocks is then subject to frequency transform coding, such as, for 

34 example, completing discrete cosine transform and quantization steps. The thus- 
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1 transformed 8X8 pixel block is zig-zag scanned to produce a one-dimensional array of 

2 transform coefficients, arranged from lowest frequency to highest frequency. Next, the 

3 array of transform coefficients is divided into one or more packets, depending on the 

4 number of resolution levels or layers desired. For example, if three resolution levels will 

5 be used, a first packet comprising the four lowest frequency coefficients is constructed. A 

6 second packet comprises the next twelve coefficients. A third packet comprises the final 

7 48 and highest frequency coefficients. If four resolution levels will be used, four packets 

8 comprising 1, 3, 12 and 48 coefficients are assembled. Other arrangements of 

9 coefficients can be used for more resolution levels. 

10 Once the packets are constructed, for each of the 8X8 pixel blocks, the first 

11 resolution level is sent to the rendering device (e.g., a display, printer, facsimile). Next, 

12 any vector and text data are sent to the rendering device. Then, subsequent resolution 

13 layers are sent to the rendering device. If a memory capacity of the rendering device is 

14 reached upon receipt of the first resolution level and the vector and text data, the 

15 rendering device may still render an acceptable image. If the memory capacity is not 

16 reached after receipt of the first resolution level and the vector and text data, the rendering 

17 device may receive the subsequent resolution level background image data, and may 

1 8 combine the data to produce a refined background image. 

19 Figure 2c shows an inverse transform operation at the rendering device. In the 

20 illustrated example, the first and second of three resolution levels have been received at 

21 the rendering device before the memory capacity of the rendering device is reached. That 

22 is, only the first 16 lowest frequency transform coefficients are received at the rendering 

23 device as shown. The received transform coefficients are arranged in an 8X8 block, with 

24 zeros representing non-received coefficients. The coefficients are then decoded using 

25 inverse quantization and inverse DCT steps to produce an approximation of the original 

26 8X8 pixel block. 

27 The processes shown in Figure 2b and 2c may be completed for an entire original 

28 image. Alternatively, the original image may be deconstructed into one or more sub- 

29 images, or swaths, and the coding and immerse coding processes may be completed fro 

30 each such swaths. Use of swaths is particularly applicable to printing operations, 

31 especially printing using large scale plotters and inkjet printers. Deconstruction of an 

32 image into swaths will be described below with reference to Figure 4. 

33 Figures 3a - 3c illustrate die effect of downsampling (which is explained in detail 

34 in U.S. Patent Application, Serial Number / . entitled "Multi-Resolution 
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1 Printing," which is hereby incorporated by reference) and frequency coding on the image 

2 rendering process. In each of Figures 3a - 3c, the horizontal axis represents the number 

3 of bits or coefficients (data) that are sent to a rendering device, such as the printer 70. 

4 The vertical axis represents the Human Visual System Picture Quality. A first, or 

5 minimum quality threshold may be specified to ensure the print quality is acceptable. 

6 Unacceptable print quality may occur when less than the entire bitmap can be printed, 

7 resulting, for example, in white stripes in the printed image due to non-receipt of image 

8 data. A situation in which no white stripes are visible may be referred to as the No 

9 Objection Quality (NOQ) level. After the NOQ level is achieved, the rate at which image 

10 quality increases (to an Intermediate Quality (IQ) level and thence to a Maximum Quality 

1 1 (MQ) level) depends on how the bitmap is sent to the rendering device. 

12 Referring to Figure 3a, a printing operation with no multi-resolution coding and 

13 no downsampling is shown. In this case, the NOQ and MQ levels are obtained at the 

14 same time, specifically when the entire image bitmap is received at the printer 70. Any 

15 image data (bitmap) transmission with fewer bits will result in objectionable quality 

16 levels. 

17 Figure 3b shows the effect of downsampling. In this case, once the first (lowest) 

1 8 resolution set of data is received at the printer 70, the image may be rendered without any 

19 white stripes. Thus, the NOQ level is achieved when the lowest resolution layer is 

20 received at the printer 70. Subsequent to reception of the lowest resolution layer, 

21 additional resolution layers received at the printer 70 provide increasing image quality up 

22 to the MQ level. 

23 Figure 3c shows the effect of frequency domain coding. In this case, NOQ is 

24 reached much sooner due to the compression (e.g., JPEG DCT or other transform domain 

25 compression). After the NOQ level is achieved, image quality increases very rapidly to 

26 close to the MQ level. At a point in the bitmap transmission (designated IQ) the image 

27 quality is as good as can be achieved (because of the inherent lossy nature of the 

28 quantization algorithms used in transform coding), and a very high quality image is 

29 possible with only the IQ bits received at the printer 70. 

30 Figure 4 illustrates a conceptual model of swath construction 300 that may be 

31 used for multi-resolution printing using low-memory printers. The image data source 

32 (represented in Figure 4 as the personal computer 22) is coupled to a plurality of printers 

33 80i. Each of the printers 80* may have a different memory capacity. Some of the printers 

34 80i may store print data (including image data) in RAM. Other printers 80* may store 
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1 print data in a hard drive, for example. The personal computer 22 may divide, or 

2 deconstruct, an image 310 to be printed into a plurality of swaths, with each swath 

3 comprising a fixed "height* 9 of die image. Thus, the image 3 10 may be deconstructed into 

4 swaths 311 - N. For example, the image 310 may be deconstructed into 10 swaths, each 

5 representing a one-inch "height" of the image 310. The personal computer 22 may then 

6 send each of the swaths 311 - N to the printers 80j in a successive fashion. That is, the 

7 personal computer 22 may send the swath 31 1 to the printers 80i, followed by the swath 

8 312, and so on until all the swaths 311 - N are sent. 

9 In an embodiment, each of the printers 80j will receive the swaths 3 1 1 - N and will 

10 attempt to store the swaths in memory. However, if a memory capacity of a particular 

1 1 printer 80j is reached before all the swaths 3 1 1 - N are received and stored, that printer 80j 

12 may begin printing the stored swaths, thereby freeing memory to store the remaining 

13 swaths. In an alternative embodiment, each of the printers 80i will immediately begin 

14 printing a received swath once the received swath is stored in memory. The thus-printed 

15 swath may then be discarded from memory. The process continues until all swaths are 

16 received, stored, printed, and discarded. 

17 In another embodiment, the concepts illustrated in Figures 2a -2c and 3c may be 

18 combined with the swath construction 300. In this embodiment, the image data source 20 

19 deconstructs an image to be printed into a plurality of swaths. Then, for each such swath, 

20 the image data source 20 completes a frequency transform operation, such as JPEG DCT 

21 coding, for example. Each swath of the image is then transferred, as a series of 

22 increasingly higher resolution layers, to a printer. The printer stores each of the swath 

23 resolution layers until a memory capacity of the printer is reached. When the memory 

24 capacity is reached, the transferred data are combined, and a swath is printed. The image 

25 data for the thus-printed swath is then discarded from memory. The image data source 20 

26 then sends the next successive swath to the printer, again in a frequency compressed 

27 coding scheme. This process continues until the entire image is rendered by the printer. 

28 In the description provided above with respect to Figure 4, only background 

29 image data was frequency encoded prior to transfer from the image data source 20 to the 

30 printer. However, as also noted above, an image to be rendered may include vector data 

31 and text data, for example. In the event that vector data and text data accompany the 

32 image data, such vector data and text data may be transferred to the rendering device after 

33 at least a minimum resolution layer of the background image data are transferred. 



9 



WO 03/039133 



PCT/US02/34876 



1 Alternatively, the vector data and the text data may be transferred before the background 

2 image data is transferred 

3 Figure 5 illustrates schematically an image data file 350 that may be transmitted 

4 from the image data source 20 to a rendering device, such as the printers 80i of Figure 4. 

5 The file 350 includes a number of image data resolution files, such as files 360, 370, 380 

6 and 390. Each of the files 360, 370, 380 and 390 in turn comprises a number of files. For 

7 example, the file 360 comprises a level 1 data header file 361, which indicates that data 

8 related to the first resolution layer will follow; a data field 362 comprising transform 

9 coefficients for the first resolution layer; a vector data field 363 comprising any vector 

10 data associated with the image; and a text data field 364 comprising text data for the 

1 1 image. The vector data in the vector data field 363 and the text data in the text data field 

12 364 may, when printed, overlay the background image data. Subsequent resolution layer 

13 files may be constructed in a manner similar to that of the file 310, 

14 Returning to Figure 4, in the illustrated system 300, an image to be printed may be 

15 deconstructed into the swaths 311 - N, assuming that a particular printer 80; will be 

1 6 capable of storing all print data associated with a particular swath. That is, the image data 

17 source 20 may have prior knowledge of the minimum memory of attached printers, and 

18 the image data source 20, when constructing the swaths, will structure the swaths such 

19 that each of the printers 80i is capable of storing all data related to the particular swath. In 

20 an alternative embodiment, the image data source 20 has no prior knowledge of printer 

21 memory capacity, and so constructs the swaths according to a set rule. The set rule may 

22 be based on average memory in most common printers, a lower limit on a range of 

23 available printer memory, or other rules. 



24 The above-described embodiments of low-memory rendering methods and 

25 devices maximize memory usage of a rendering device. In particular, the embodiments 

26 allow the rendering device to render a background image having an acceptable quality 

27 level, and to also render text and vector data. The quality of the background image may 

28 be improved for rendering devices having larger memory capabilities. 

29 Figure 6 is a flowchart illustrating a process 400 that may be carried out to 

30 provide multi-resolution printing with low-memory printers. The process 400 may be 

31 carried out using the system 10 shown in Figure la, with an image being deconstructed 

32 into swaths according to Figure 4 and layers within swaths according to Figures 2a - 2c. 

33 The process 400 begins with start block 405. In block 410, the personal computer 

34 22 receives an image to be printed, and deconstructs the image into N swaths. The image 
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1 to be printed may comprise image data, vector data and text data, with the vector and text 

2 data overlaying the image data, for example. Alternatively, some or all of the vector data 

3 and/or some or all of the text data may be included in an area of the image that does not 

4 overlay the image data. In deconstructing the image to be printed into N swaths, the 

5 personal computer 22, executing the process block 410, may use a height of the image to 

6 be printed to determine the "height" of each of the N swaths. Alternatively, the personal 

7 computer 22 may determine a data density of the image to be printed, and may adjust the 

8 heights" of each of the N swaths according to a nominal or a known memory capacity of 

9 printer that may print the image to be printed. The personal computer 22 may determine 

10 the data density by, for example, scanning the image, reading data density information 

1 1 from a file accompanying the image to be printed, or by other means. When setting the 

12 swath "height," the personal computer need not make the heights" of each of the N 

13 swaths equal. 

14 In select swath block 415, the personal computer 22 selects the i* swath, starting 

15 with the first swath of the image to be printed. The first swath may typically be a swath 

16 located at a top of the image to be printed. In multi-resolution coding block 420, the 

17 personal computer 22 executes a sub-routine 420 to transform the background image data 

18 of the i* swath into the frequency domain. Such a frequency encoding routine is 

19 described in detail with reference to Figure 8. 

20 In send data block 425, the personal computer 22 transfers print data associated 

21 with the i m swath to one or more printers that may be coupled to the personal computer 

22 22. In an embodiment, the print data associated with the I th swath may be transferred after 

• *th 

23 all resolution layers are constructed. Alternatively, the print data associated with the i 

24 swath may be transferred one resolution layer at a time. If the i* swath includes only one 

25 resolution layer, then the print data associated with the i* swath may be transferred as 

26 soon as the N swaths are created. Figure 9 shows the send data subroutine 425 in more 

27 detail. 

28 In increment counter block 430, the personal computer 22 may increment a 

29 counter to advance the swath number by one increment. In block 435, the personal 

30 computer 22 determines if the thus-incremented value of i equals N. If the values equal, 

31 the process 400 proceeds to block 440 and ends. Otherwise, the process 400 returns to 

32 block 415, and the next swath is selected. 

33 Figure 7 is a flowchart illustrating the subroutine 410 for dividing the image to be 

34 printed into swaths. In block 411, the personal computer 22 determines a size of the 
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1 image to be printed. In an embodiment, the personal computer 22 determines overall 

2 dimensions (height and width in inches, for example) of the image to be printed, as the 

3 image will appear when rendered onto a print medium. The personal computer 22 may 

4 also determine data density of the image to be printed (for example, the number of pixels 

5 in the image, vector data and text data). In block 412, the personal computer 22 

6 determines if any printer that is designated to print the image has provided memory 

7 capacity information. If memory capacity information has been provided, the subroutine 

8 410 may proceed to block 413, and select a swath "height" based on the provided 

9 memory capacity information. The subroutine 410 then ends, and processing returns to 

10 the main routine 400 for multi-resolution printing. 

11 In block 412, if the personal computer 22 determines that memory capacity 

12 information has not been provided, then processing may proceed to block 414, and the 

1 3 swath "height" may be selected based on a pre-defined rule. For example, the pre-defined 

14 rule could specify that each swath should have a "heighf ' corresponding to one (1) inch 

15 of vertical height of the image to be printed. The subroutine 410 then ends. 

16 As noted above, each of the N swaths determined in block 410 may be further 

17 resolved into a number of resolution layers. Alternatively, the entire image to be printed 

18 may be resolved into a number of resolution layers, and no swaths would then be 

19 constructed. • 

20 Figure 8 illustrates the frequency coding sub-routine 420 that may be used to 

21 encode an entire image bitmap, or to encode each swath of the image. The sub-routine 

22 420 begins by dividing the image (or resolution layer or swath) into 8X8 pixel blocks 

23 (block 490). In block 492, each of the 8X8 pixel blocks is transformed into the frequency 

24 domain by using a JPEG DCT coding scheme. Next, in block 494, each of the 

25 transformed 8X8 pixel blocks is quantized using a JPEG standard quantization table. In 

26 block 496, the quantized frequency coefficients are read out into a one-dimensional array 

27 in preparation for transmission from the image data source 20. In block 498, the array of 

28 transform coefficients is packetized according to the number of resolution levels desired. 

29 The sub-routine 420 then ends, block 499, and processing returns to block 425. 

30 Figure 9 is a flowchart that illustrates the send data sub-routine 425. In block 500, 

31 a first level header data is generated, containing data specifying that a multi-resolution 

32 format will follow, and specifying the first resolution level (i.e., resolution layer 1). In 

33 block 505, the first level image data is sent from the personal computer 22, comprising 

34 the first level of frequency coefficients. In block 510, vector data is sent in a vector field. 
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1 In block 515, text data describing any text additions to the image is sent in a text data 

2 field In block 520 second level header data is sent indicating second resolution level 

3 image data (i.e., frequency coefficients) will follow. In block 525, the second resolution 

4 level image data, at a higher resolution than the first resolution level image data is sent. 

5 In block 530, a third level header data is sent indicating third resolution level image data 

6 will follow, and in block 535, third resolution level image data is sent, being of a higher 

7 resolution than the first level or second level image data. Successive levels of image data, 

8 each preceded by a header data are sent until the highest resolution level image data is 

9 sent. 

10 Successive levels of resolution of image data may be sent, up the maximum 

11 resolution obtainable from the source image data. Therefore, the process steps through 

12 sending levels 1 - M of image data and stops, when the maximum resolution permitted by 

13 the source image data has been reached 

14 The above-described embodiments allow rendering of high resolution vector and 

1 5 text data, on a rendering device having a limited memory area, where a background image 

16 is rendered with a resolution that is limited by an available memory capacity or data 

17 storage capacity of the rendering device. For example, an architect's drawing may 

18 comprise an aerial photograph of a land site, together with an architectural drawing, 

19 specified in vector data, plus some text data overlaying the aerial image. The resolution of 

20 rendering of the aerial image may be limited by a printer's memory, but the resolution of 

21 the architectural drawing and text data are not limited by the memory or data storage 

22 capacity of the printer device, but are always printed in very high resolution, for example 

23 using the HPGL2 vector graphics language. 

24 The same image data file sent to a different printer or rendering device having a 

25 higher memory capacity and/or data storage capacity, may provide a hi^ier resolution 

26 background image data, and with vector and text data information at the same resolution 

27 as the lower memory capacity/data storage capacity printer device. 
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1 In the claims: 

2 1. A method for rendering an image comprising an image data file, the image data 

3 file including vector data and text data, using multi-resolution frequency coding, the 

4 method, comprising: 

5 performing (492) a frequency transform on image data in the image data file, 

6 whereby frequency transformed coefficients are produced; 

7 quantizing (494) the frequency transformed coefficients; 

8 scanning (496) the quantized frequency transformed coefficients, wherein the 

9 scanned, quantized and frequency transformed coefficients comprise an array of 

1 0 transform coefficients from lowest to highest frequency; 

1 1 packetizing (498) the transform coefficients into one or more resolution levels; 

12 sending (505) at least a lowest resolution level to a rendering device; and 

13 sending the vector data (510) and the text data (515) to the rendering device. 

14 2. The method of claim 1 , further comprising: 

15 dividing (410) the image data file into one or more swaths, wherein each of the 

16 one or more swaths comprises a subset of data from the image data file, the dividing step, 

17 comprising: 

1 8 deteniiining a data density quantity for the image data file, and 

19 constructing the one or more swaths to include a specified height of the 

20 image data file; and 

2 1 successively providing (425) each of the plurality swaths to the rendering device. 

22 3. The method of claim 2, wherein each of the plurality of swaths is subjected to the 

23 multi-resolution frequency coding. 

24 4. The method of claim 2, wherein the rendering device is a printer (70). 

25 5. The method of claim 1, wherein the rendering device is one of a display (30) of a 

26 personal computer (22), a display (24) of a mobile electronic device (20), and a facsimile 

27 machine. 

28 6. The method of claim 1, wherein the vector data and the text data is sent to the 

29 rendering device after sending the lowest resolution level. 

30 7. The method of claim 6, further comprising: 

31 sending one or more higher resolution levels to the rendering device after sending the 

32 vector data and the text data; 

33 sending one or more higher resolution levels after sending the lowest resolution level. 

34 8. A method for low-memory rendering of an image, comprising: 
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1 first processing (400) the image to be rendered according to a first rule, whereby 

2 first subdivision segments are produced, and wherein the image comprises an image data 

3 file; 

4 second processing (420) one or more of the first subdivision segments according 

5 to a second rule, whereby multi-resolution layers are produced; and 

6 sending (425) the multi-resolution layers and the segments to a rendering device, 



7 wherein the first rule constructs a sequence of swaths (310), the subdivision segments 

8 comprising the swaths, wherein the second rule provides frequency domain encoding of 

9 one or more of the swaths to provide the multi-resolution layers, and wherein the multi- 

10 resolution layers are encoded using discrete cosine transform (DCT) coding, comprising: 

1 1 dividing the image into 8X8 pixel blocks (490); 

12 performing DCT (492) and quantization (494) of the pixel blocks to produce 

1 3 transform coefficients; 

14 scanning (496) the transform coefficients; and 

15 packetizing (498) the scanned transform coefficients to produce the multi- 

1 6 resolution layers. 

17 9. The method of claim 8, wherein each of the swaths comprises a subset of data 

1 8 from the image to be rendered, the dividing step, comprising: 

19 determining (41 1) a data density quantity for the image data file, and 

20 constructing (414) the one or more swaths to include a specified height of 

21 the image to be printed. 

22 10. A computer-readable medium comprising programming for low-memory 

23 rendering, the programming used for performing image processing steps, comprising: 

24 performing (492) a frequency transform on image data related to an image, 

25 whereby frequency transformed coefficients are produced; 

26 quantizing (494) the frequency transformed coefficients; 

27 scanning (496) the quantized frequency transformed coefficients, wherein the 

28 scanned, quantized and frequency transformed coefficient comprises an array of 

29 transform coefficients from lowest to highest frequency; 

30 packetizing (498) the transform coefficients into one or more resolution layers; 

3 1 sending at (505) least a lowest resolution level to a rendering device; 

32 sending text (515) and vector (510) data after sending the lowest resolution level; 

33 and 

34 sending (525, 535) one or more higher resolution levels. 
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